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METHOD, SYSTEM AND COMPUTER PROGRAM PRODUCT FOR FULL 
NEWS INTEGRATION AND AUTOMATION IN A REAL TIME VIDEO 
PRODUCTION ENVIRONMENT 
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BACKGROUND OF THE INVENTION 



Field of the Invention 

[0003] The present invention relates generally to video production, and more 

specifically, to automating the execution of a live or live-to-tape video show. 

Related Art 

[0004] Conventionally, the execution of a live or live-to-tape video show, such as 

a network news broadcast, talk show, or the like, is largely a manual process 
involving a team of specialized individuals working together in a video 
production environment having a studio and control room. The video production 
environment is comprised of many diverse types of video production devices, 
such as video cameras, microphones, video tape recorders (VTRs), video 
switching devices, audio mixers, digital video effects devices, teleprompters, and 
video graphic overlay devices, etc. The basics of video production techniques is 
described in "Television Production Handbook," Zettl, 1997 Wadsworth 
Publishing Company, which is incorporated herein by reference. 

[0005] In a conventional production environment, the video production devices 

are manually operated by a production crew (which does not include the 
performers and actors, also known as the "talent") of artistic and technical 
personnel working together under the direction of a director. A standard 
production crew is made up of nine or more individuals, including camera 
operators (usually one for each camera, where there are usually three cameras), a 
video engineer who controls the camera control units (CCUs) for each camera, a 
teleprompter operator, a character generator (CG) operator, a lighting director 
who controls the studio lights, a technical director who controls the video 
switcher, an audio technician who controls an audio mixer, tape operator(s) who 
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control(s) a bank of VTRs, and a floor director inside the studio who gives cues to 
the talent. Typically, the director coordinates the entire production crew by 
issuing verbal instructions to them according to a script referred to as a director's 
rundown sheet. Generally, each member of the production crew is equipped with 
a headset and a microphone to allow constant communications with each other 
and the director through an intercom system. 

[0006] The director's rundown sheet also includes instructions from the show's 

producer. For instance, to produce a news program, the producer generally selects 
the news stories that will be featured on the show. Once selected, the producer 
creates a show rundown identifying the stories and delivers the show rundown to 
the director. The director, in turns, uses the show rundown as the basis for 
creating the director's rundown sheet. 

[0007] During the execution of a live or live-to-tape video show, the production 

crew must perform multiple parallel tasks using the variety of video production 
devices. Furthermore, these tasks must all be coordinated and precisely 
synchronized according to very strict timing requirements. Coordination between 
the production crew, the director and the talent is vitally important for the 
successful execution of a show. Moreover, the producer's input (via the 
producer's show rundown) also significantly influences the execution of the 
show. Accordingly, the logistics of executing a show are extremely difficult to 
plan and realize. 

[0008] As such, executing a show is extremely susceptible to errors. The industry 

knows that errors are generally expected to occur during the execution of a show. 
Accordingly, experienced production crews not only attempt to reduce the 
frequency of errors, but also attempt to react quickly in taking corrective action so 
that the inevitable errors that do occur are unnoticed by the viewing audience. 
However, it is quite apparent by watching live television broadcasts that this goal 
is not always met 
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[0009] Another problem with the conventional production environment is that the 

director does not have total control in executing a show because of the director's 
reliance on the production crew. The production crew does not always follow the 
instructions of the director due to mis-communication and/or misinterpretation of 
the director's cues. Further, the director cannot achieve certain desired transitions 
and sophisticated or enhanced visual effects because of the real time nature of the 
execution of the show and the fast paced/short time available. Additionally, the 
director must also incorporate instructions from the producer (i.e., show rundown) 
that are also subject to mis-communication and/or misinterpretation. 

[0010] Another problem arises from the inability to quickly and accurately 

incorporate changes into the director's rundown sheet. For example, if the 
producer decides to add or drop a news story from a news program, these 
instructions must be communicated to the director so that the rundown sheet can 
be appropriately adjusted. The time and level of effort to implement these changes 
adversely affect the time and costs of producing a live broadcast. Similarly, if the 
contents of the news story should change prior to broadcast, it would be difficult 
to timely and accurately update the teleprompter, transitional elements and visual 
effects during a live broadcast. Consequently, the talent (i.e., news correspondent) 
may not have the latest available data. 

[0011] The real time nature of the execution of the show creates great stress for 

the director, producer, production crew, and talent. Everyone is extremely 
concerned about failure. The real time nature of the execution of the show also 
necessitates re-creation of the format, including transitions and special effects, for 
the show. 

[0012] Another drawback of the conventional production environment, is that 

failure of any member of the production crew to be present for the execution of 
the show may prevent or hamper the show from occurring as planned. Thus, 
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directors constantly worry about whether crew members will show up for work, 
particularly on weekends and holidays. 

[0013] Conversely, there are situations in other than broadcast environments, 

such as business television and video training environments, where due to 
downsizing or budgetary constraints the number of available personnel for the 
production crew is so limited that shows cannot be produced with high quality. 

[0014] Producing live or live-to-tape video shows is very expensive because of 

the large size of the video production crew. The compensation to the individuals 
that make up the production crew is substantial, and can run in the range of 
several million dollars per year for the entire crew. Furthermore, the 
compensation for a member of a production crew is commensurate with the video 
market of the station. The level of compensation for the top markets is 
substantially higher than for the lesser markets, and the compensation for network 
affiliates is higher than independent broadcasters and cable networks. This 
disparity in compensation produces frequent turnover in production crew 
personnel causing a director to frequently hire and train new members of the 
crew. 

[0015] Another disadvantage with the conventional production environment is the 

inability to preview the show. That is, it is costly and impractical for the 
production crew to rehearse the show prior to its execution. The talent and the 
director cannot preview the transitions in a succinct manner. 

[0016] Another problem with today's conventional production environment is the 

hand-off from the producer who is the architect of the show to the director who is 
the person responsible for assigning sources and executing the show. In the early 
days, producer rundowns were created manually on paper as a form of putting 
together the show. New technology allows for this process to be used in 
networked computers. Companies such as iNEWS (i.e., the iNEWS™ news 
service available on the iNews.com website), Newsmaker, Comprompter, and the 
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Associated Press (AP) have developed news automation systems to manage the 
workflow processes associated with a newsroom operation. A news automation 
systems is a network-based service that aggregates stories from news services 
such as AP, Konas and CNN services in addition to local police and fire station 
monitoring as well as field reporters from the broadcast station. During a news 
automation process, all components of a news production (including wire 
services, assignment editor, reporters, editors, producers and directors) are 
connected so that the show building process can be streamlined with file sharing, 
indexing and archiving by show names. This allows the producer and director to 
develop a text-based rundown sheet, and always know the status of stories during 
the rundown assembly process. The missing link is an elegant method of hand-off 
from the producer to the director for show execution in an automated 
environment. 

[0017] Therefore, what is needed is a video production system and method that 

addresses the above problems. 

SUMMARY OF THE INVENTION 

[0018] The present invention solves the above identified problems in 

conventional systems by providing full news integration and automation to a 
video production system, method and computer program product (herein 
collectively referred to as the "Full News Integration and Automation System," 
"Full News System," "system" or "the present invention" for purposes of brevity). 
The system and method of the present invention automatically converts a show 
rundown into a set of computer readable broadcast instructions (herein referred to 
as "broadcast instructions") and automates the execution of a live or live-to-tape 
video show. In an embodiment, the set of broadcast instructions is created from 
the Transition Macro™ timeline-based application program, developed by 
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ParkerVision, Inc. (Jacksonville, FL), that can be executed to control an 
automated video production system (A VPS) that supports live and live-to-tape 
broadcasts of a television program. The AVPS is preferably, but not necessarily, 
of the type described in commonly assigned U.S. Patent Application No. 
09/215,161, filed December 18, 1998, filed by Holtz et aL, and entitled "Real 
Time Video Production System and Method" (hereinafter referred to as "the '161 
application"). The disclosure of the c 161 application is incorporated herein by 
reference as though set forth in its entirety. 

[0019] The AVPS is configured to allow a single person (e.g., a video director) to 

control all video production devices used in executing the show. Such devices 
include, but are not limited to, video cameras, robotic pan/tilt heads, video tape 
players and recorders (VTR)s, video servers and virtual recorders (VR)s, 
character generators (CG)s, still stores, digital video disk players (DVD)s, digital 
video effects (DVE)s, audio mixers, audio sources (e.g., CDS and DATs), video 
switchers, and teleprompter systems. 

[0020] The full news integration and automation capability provided by the 

present invention allows a producer to select news stories from a plurality of 
sources and create a show rundown. The rundown is automatically converted to a 
computer readable format to instruct the AVPS. As a result, the automation 
capability provided by the AVPS allows the video director to pre-produce a live 
show (such as, a news show, talk show, or the like), preview the show in advance 
of air time, and then, with a touch of a button or other trigger, execute the live 
show by stepping through it (from element to element or story to story) in an 
event driven manner. Consequently, a live show or live-to-tape show can be 
executed more cost efficiently, with greater control over logistics and personnel, 
with enhanced functionality and transitions, in less time and with less stress, and 
with fewer people and fewer human errors than was previously possible. The 
method and system of the present invention also allow the video director leverage 
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templates to reuse formats of prior shows, or rebuild shows quickly and 
efficiently. 

[0021] In an embodiment of the present invention, news stories are collected from 

a plurality of sources and stored in a file on a library within a computer server. 
The producer creates a show rundown by compiling a list of news stories. The 
show rundown identifies the location of each news story file and any affiliated 
video or audio recordings. The AVPS automatically converts the show rundown 
to broadcast instructions that can be used to execute the show. 

[0022] Once the AVPS creates the broadcast instructions, the director can instruct 

the AVPS to execute the broadcast instructions in either a full automation mode 
or a semi-automatic mode, as described in the c 161 application. It should be noted 
that the broadcast instructions, whether executed in fully or semi-automatic mode, 
can always be overridden by manual controls. That is, the video director always 
has the ability to manually control a video production device, regardless of 
whether the broadcast instructions are in the process of being executed. After 
executing the show, the broadcast instructions and a video recording of the show 
is saved for future use. 

[0023] In another embodiment of the present invention, the broadcast instructions 

can be retrieved and used in another show. Similarly, the recording of the show 
can be retrieved and re-broadcasted. In an embodiment of the present invention, 
the re-broadcast is transmitted over the Internet. 

[0024] An advantage of the present invention is the real time conversion of the 

show rundown to broadcast instructions with little to no human intervention. This 
process saves time and mitigates errors due to mis-communication or 
misinterpretations. 

[0025] Another advantage of the present invention is that each news story 

identified in the broadcast instructions are linked to the news stories in the show 
rundown. Therefore, changes to the show rundown (i.e., addition or deletion of 



SKGFRef.; 1752.0130001 



-9- 



news stories) can be incorporated into the broadcast instructions with minimal 
human interference. 

[0026] Another advantage of the present invention is that the broadcast 

instructions can be modified while a show is executing. This feature allows the 
producer to modify the content of a show in real time. For example, it allows the 
producer to introduce a late breaking news segment, drop news stories, update the 
news stories or the like into a news broadcast, as the show is being aired. 

[0027] The cost and time savings of the present invention are therefore 

substantial. Typically, it takes a half hour to an hour for a director to create a 
graphical representation of the show for execution from the producer's rundown. 
In the present invention, the conversion is implemented in a nominal amount of 
time. Additionally, the human errors that normally occur during the execution of a 
show are no longer an issue. 

[0028] Further features and advantages of the present invention, as well as the 

structure and operation of various embodiments of the present invention, are 
described in detail below with reference to the accompanying drawings. 



BRIEF DESCRIPTION OF THE DRAWINGS/FIGURES 

[0029] The accompanying drawings, which are incorporated herein and form part 

of the specification, illustrate the present invention and, together with the 
description, further serve to explain the principles of the invention and to enable a 
person skilled in the pertinent art to make and use the invention. In the drawings, 
like reference numbers indicate identical or functionally similar elements. 
Additionally, the leftmost digit(s) of a reference number identifies the drawing in 
which the reference number first appears. 

[0030] FIG. 1 illustrates an embodiment of a foil news integrated and automated 

video production system of the present invention. 
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[0031] FIG. 2 shows a flow chart representing the general operational flow 

according to an embodiment of an automated video production method of the 
present invention. 

[0032] FIG. 3 shows a flow chart representing the general operational flow 

according to an embodiment of a full news integrated and automated video 

production method of the present invention. 
[0033] FIG. 4 shows a flow chart representing the general operational flow 

according to an embodiment of the present invention for a full news integrated 

and automated video production method for subsequent broadcasts. 
[0034] FIG. 5 illustrates a block diagram of an exemplary processing system 

useful for implementing the present invention. 
[0035] FIG. 6 illustrates a second embodiment of a foil news integrated and 

automated video production system of the present invention. 
[0036] FIG. 7 illustrates a representative teleprompter system GUI according to 

an embodiment of the present invention. 
[0037] FIG. 8 illustrates a representative BCE GUI according to an embodiment 

of the present invention. 
[0038] FIG. 9 illustrates a representative Rundown GUI according to an 

embodiment of the present invention. 
[0039] FIG. 10 illustrates a representative GUI for entering broadcast instructions 

according to an embodiment of the present invention. 
[0040] FIG. 1 1 illustrates a representative GUI containing broadcast instructions 

according to an embodiment of the present invention. 
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DETAILED DESCRIPTION OF THE INVENTION 



I. Overview of the Present Invention 

[0041] The present invention is directed to a system, method and computer 

program product (herein referred to collectively as the "Full News Integration and 
Automation System," "Full News System," "system" or "the present invention" 
for purposes of brevity) for automatically converting a show rundown into 
computer readable broadcast instructions (such as the ParkerVision® Transition 
Macro™ timeline-based automation control program), to be executed in an 
automated video production system (A VPS) that supports live and live-to-tape 
broadcasts of a television program. The AVPS is preferably, but not necessarily, 
of the type described in the '161 application. 

[0042] FIG. 1 illustrates, according to an embodiment of the present invention, a 

fully integrated and automated video production system 100. The present 
invention includes analog and digital video production environments. As shown 
in FIG. 1, video production system 100, in a representative embodiment, includes 
a plurality of workstations, a server 110 and an automated video production 
system (AVPS 116), all connected to each other by a central bus 118 to form a 
local area network (LAN), wide area network (WAN), or the like as would be 
apparent to a person skilled in the relevant art(s). Bus 118 can be a coaxial, fiber 
optic or twisted cable used for bi-directional communications. Bus 118 is 
configurable to support broadband or baseband, such as Ethernet, network 
protocols. As described above, AVPS 1 16 is preferably, but not necessarily, of the 
type described in the '161 application. 

[0043] System 100 also includes computer workstations for a news assignment 

editor 102, producer 104, news services 106, local reporter or correspondent 108, 
director 112 and teleprompter system 114. The news services station 106 can be 
used to access information from wire services or news automation services, such 
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as AVSTAR™ (renamed "iNEWS"and purchased by AVID Technologies, Inc.) 
and the Associated Press (AP products include NewsCenter and ENPS), through 
server 110. Alternatively, one can use one of the other workstations to directly 
access the news automation services through server 110. It would be readily 
apparent to a person skilled in the relevant art(s) that additional workstations can 
be connected to bus 1 18 to support system 100. For instance, any member of a 
television studio that plays a role in identifying, creating and editing news stories 
and generating a show rundown can have a separate workstation connected to bus 
1 1 8 or can use one of the workstations depicted in FIG. 1 . 

Server 110 represents one or more computers providing various shared 
resources with each other and to the other network computers. The shared 
resources include files for programs, web pages, databases and libraries; output 
devices, such as, printers, plotters, teleprompter systems 114 and audio/video 
recorders and players; and communications devices, such as modems and Internet 
access facilities. The communications devices can support wired and wireless 
communications, including satellite, terrestrial, radio, microwave and any other 
form or method of transmission. Server 1 10 is configured to support the standard 
Internet Protocol (IP) developed to govern communications over public and 
private Internet backbones. The protocol is defined in Internet Standard (STD) 5, 
Request for Comments (RFC) 791 (Internet Architecture Board). Server 110 can 
also support transport protocols, such as, Transmission Control Protocol (TCP), 
User Datagram Protocol (UDP) and Real Time Transport Protocol (RTP). Server 
110 is also configured to support various operating systems, such as, the 
Netware™ system available from Novell®; the MS-DOS®, Windows NT® and 
Windows® 3.xx/95/98/2000 systems available from Microsoft®; the Linux® 
system available from Linux Online Inc.; the Solaris™ system available from Sun 
Microsystems, Inc.; and the like as would be apparent to one skilled in the 
relevant art(s). 
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II. Automated News Video Production 

[0045] Referring to FIG. 2, flowchart 200 represents the general operational flow 

of an embodiment of the present invention. More specifically, flowchart 200 
shows an example of a control flow for producing a news program in an 
automated video production environment. Generally, the producer is the architect 
of the news program. The producer selects the news stories, assembles and 
organizes a show rundown that provides the organization, identification and 
timing of a particular broadcast of the news program by element or news story. 
The elements can include instructions to implement specific effects with the news 
story, such as voice over (VO), sound on tape (SOT), over the shoulder (OTS), 
introduction, package and tag (INTRO/PACKAGE/TAG), or the like. In practice, 
the show rundown continuously changes based on breaking news and field 
acquisition timing. 

[0046] To select the news stories, the producer can either use local reporters to 

acquire the information or select the news story from a news automation service. 
The first method is illustrated at step 204. At step 204, assignment desk personnel, 
using workstation 102, are responsible for monitoring incoming news, including 
news automation services and local police, fire or rescue monitoring. Assignment 
desk personnel work in conjunction with the producer to determine which news 
stories are selected for the news program. Assignment desk personnel are also 
responsible for reporter and equipment assignment and scheduling. Accordingly, 
a local reporter(s) is assigned to cover a particular news event that can be on 
topics related to weather, sports, human interests, market updates, and the like. 

[0047] After the local reporter receives the assignment, at step 208, the local 

reporter researches the assigned news story and develops a script and package as 
defined by the producer. The reporter's assignment typically includes field 
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acquisition with a videographer in some cases. As such, the reporter would visit 
the scene of the neys event to make audio or video recordings to be used in a 
news clip. The reporter generally interviews the subject or witnesses, as 
appropriate, and collects other data to support the news clip. 

[0048] In some instances, reporters would perform their own editing. In such 

cases, after the local reporter has gathered sufficient data, at step 212, the reporter 
utilizes workstation 108 to edit the news clip. During this process, the local 
reporter writes the script and selects graphics (e.g., inserts character generators 
into the script), as appropriate. Typically, the reporter does not generate the 
graphics, but rather include the text within a graphics template, such as a lower 
3rd. The finished product is a news story for broadcast on the news program. 

[0049] At step 220, the news story is saved to a news story file or news story 

folder within a directory or library on server 110. Referring again to FIG. 1, 
server 1 10 can represent one or more computers used to support the information 
process flow in system 100. However, in another embodiment, server 110 
represents multiple servers that support specific functions within system 100. 
Multiple servers are shown in FIG. 6 that illustrates a second embodiment of 
system 100. In this representative embodiment, server 110 is shown as wire 
services server 622, data server 624, video editing server 626 and video playout 
server 628. In this embodiment, data server 624 acts as the central repository of 
news stories prepared by the reporter. Data server 624 accordingly would include 
the script, script commands and CG commands that are prepared at steps 208-212. 
In an embodiment, script commands are embedded within the text of the script to 
instruct teleprompter system 114 (such as, the SCRIPT Viewer™ teleprompter 
system available from ParkerVision, Inc.) to, for example, pause, delay, cue or 
stop the script. Thus, the parsing of the script and CG commands is performed by 
teleprompter system 1 14. Teleprompter system 1 14 then forwards the commands 
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via AVPS 116 to the CG which is typically connected to AVPS 116 via an RS- 
232 connection. 

[0050] Additionally, as shown in Fig. 6, the reporter can use video edit station 

120 to edit the news clip produced during field acquisition 632, as discussed at 
step 208. Video editing server 626 and video playout server 628 can be used to 
archive the news clip prior and subsequent, respectively, to the completion of the 
editing process. Wire services server 622 can also be used to select news stories 
from news automation services, as discussed at step 216 below. Wire services 
server 622 also support archiving and retrieval of the selected news stories. As 
discussed with reference to server 110, wire services server 622 can support 
satellite communications 630, as shown in FIG. 6, as well as terrestrial, radio, 
microwave and any other form or method of wired or wireless transmission. 

[0051] Consequently referring again to FIG. 2, at step 220, each news story file 

located in data server 624 contains a script and associated text for graphics 
created by the reporter. The news story file also includes links to the associated 
video clip or audio recording located in video playout server 628. The script 
includes the text of the story that can be loaded onto teleprompter system 114. 
The text can be saved in any standard format that can be converted to rich text 
format for display on a screen for teleprompter system 1 14. In addition to the text 
being read by the talent, the news story file also includes commands and 
instructions to incorporate triggers, links, or other specific text and/or graphic 
effects associated with the news story. The commands and effects can include 
links to files containing video, audio, character generators, still stores, keyers and 
other devices. For example, the news story file can include embedded instructions 
to append a file having a video clip of a story related to the text stored in the file. 

[0052] Alternatively, as shown at step 216, news stories can be selected from one 

or more news automation services. News automation services, such as Konas, 
CNN and the Associated Press, collect news stories on a variety of subjects from 
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numerous reporters. The subjects include both local and global topics of interests. 
Referring back to FIG. 1, using any of the workstations linked to bus 118, studio 
personnel can access the news stories by using the communications device 
coupled to server 110. Also, wire services server 622 can be used to access the 
news stories as shown in FIG. 6. After one has selected a particular news story of 
interest, at step 220, the news story can be saved to a file or directory on server 
1 1 0 or wire services server 622. 

[0053] For example, a local reporter can select a news story from a news 

automation service, edit the story, write a script and select graphics to create a 
news story for broadcast. The edited story would then be saved to a news story 
file or news story folder. In other words, server 1 10 is also a story bin containing 
a collection of various news stories on a variety of topics. Referring again to FIG. 
6, data server 624 can also serve as the story bin. The story bin can be configured 
to have separate directories or libraries for storing news stories from each source 
(e.g., Konas, CNN , Associated Press, individual local reporter, and the like). 

[0054] At step 224, the producer searches the story bin within server 1 10 or data 

server 624 to select news stories for the news program's show rundown. 
Typically, the producer lists the news stories to create the show rundown at 
workstation 104 and delivers the document to the show's director. The show 
rundown can be hand delivered to the director or electronically mailed to the 
director's workstation 112. The show rundown can also be saved to a file on a 
directory or library in server 110 which is subsequently read by the director at 
workstation 112. 

[0055] At step 228, the director receives the show rundown and creates a 

director's rundown sheet. The director manages the on-air presentation of the 
news program. The director is responsible for the look and feel, camera shots, 
sources, transitions and other elements required to execute the show. After 
completing the rundown sheet, the director will call the show. Calling the show is 
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basically the act of communicating what happens next to all production stations, 
including the video switch operator, audio operator, graphics operator, camera 
operators, teleprompter operator, tape machine operators and the like. The 
director coordinates the entire production crew by issuing verbal instructions to 
them according to the director's rundown sheet. Each member of the production 
crew is equipped generally with a headset and a microphone to allow constant 
communications with each other and the director through an intercom system, 
e.g., Interruptible Feedback (IFB) system for communications with on-air talent 
that provides program sound or instructions from the producer or director. 
[0056] However, as described in the 4 161 application, AVPS 116 enables the 

video director to automate the execution of the news program or show. To do so, 
the director must instruct AVPS 1 16 to read and execute the information on the 
rundown sheet. This is accomplished by creating computer readable "broadcast 
instructions" to specify one or more video production commands as described in 
the '161 application in regards to the ParkerVision® Transition Macro™ 
program. 

[0057] As shown at step 232, the director enters the broadcast instructions into 

AVPS 116, and at step 236, AVPS 116 executes the show based on the broadcast 
instructions. Executing the broadcast instructions, or executing the show based on 
the broadcast instructions, means transmitting the one or more video production 
commands that are specified by the broadcast instructions to the appropriate video 
production devices. Upon receiving a video production command, a video 
production device performs the function corresponding to the received command. 
In this manner, AVPS 116 provides automated control of the video production 
devices, and thereby provides a system for automating the execution of a show in 
real time. This feature provides the director with the advantage of not having to 
rely on a production crew to execute a show. The cost and time savings this 
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feature provides are therefore substantial. Additionally, the human errors that 
normally occur during the execution of a show can be mitigated. 
[0058] However, the system illustrated in 200 is not completely free of the 

inefficiencies attributable to human intervention. For instance, if the producer 
subsequently decides to add or drop a news story, or otherwise revises the show 
rundown, this information would have to be communicated to the director so that 
the broadcast instructions can be modified. If the contents of the news stories 
should change prior to broadcast, these changes also would have to be 
communicated to the director. Furthermore, during the process of converting the 
show rundown to broadcast instructions, or revising the broadcast instructions, the 
director can make errors or omit to include required information. In all of these 
instances, there exist a probability of making mistakes and a significant increase 
in the cycle time for producing the news program. 

III. Full News Integration and Automation 

[0059] The method and system of the present invention overcomes these 

problems by providing a mechanism to automatically convert the show rundown 
to broadcast instructions with less human intervention. Referring to FIG. 3, 
flowchart 300 represents the general operational flow of an embodiment of the 
present invention. More specifically, flowchart 300 shows an example of a 
control flow for producing a news program in a video production environment 
having full news integration and automation. 

[0060] Steps 204 to 220 are identical to the process steps in FIG. 2 for control 

flow 200. After step 220, control flow 300 begins to differ significantly from the 
embodiment described in control flow 200. At this point, control flow 300, passes 
to step 304. At step 304, the producer, once again, searches the story bin within 
server 1 10 or data server 624 to select news stories to create the producer's show 
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rundown. However, instead of saving the show rundown to a file or manually 
delivering it to the director, at step 304, the show rundown is saved to a show 
folder on a directory or library within server 110 or data server 624. The show 
folder is a file containing a complete listing of the news stories that have been 
selected for broadcast. The show folder identifies the current location, i.e., path 
and filename for each news story. If the status or location of the news stories 
should subsequently change, system 100 automatically updates the information in 
each affiliated show folder. For example, if the show folder includes a file 
downloaded from an automated news service, the show folder would have a 
hyperlink to the file's location on the server (not shown) for the automated news 
service. Therefore, if the contents of the news story should change, these changes 
would automatically be incorporated into the show folder. 
[0061] At step 308, the director, using workstation 112, instructs AVPS 116 to 

select a specific show folder that has been created by the producer. AVPS 116 
reads and translates the information within the show folder as described in detail 
in reference to FIG. 9. By translating the information, AVPS 116 transfers the 
data from the show folder to a show template and, as result, generates broadcast 
instructions for executing the show. The show template is a generic set of 
broadcast instructions that can be reused many times to produce a variety of 
different shows. The show template contains a set of standard commands, 
including transitional elements and instructions, to the production crew to 
integrate a plurality of elements to execute the show. For instance, the elements 
can include video switching with a defined transition effect; audio mixing; camera 
controls (such as pan, tilt, zoom and focus); external machine controls, via 
communication protocols (such as a play, search and stop command for video 
tape recorders (VTR)s, video servers/virtual recorders (VR)s, digital video 
devices (DVD)s, and digital audio tape (DAT) and cassette equipment); 
teleprompting system controls; graphics controls (such as digital video effects 
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(DVE) and character generators and/or still stores); general purpose interface 
commands for input/output contact closures (momentary and latching) to control 
external equipment without the need for using a communications protocol (such 
as studio lighting); and other special effects. 

[0062] The show template is basically a stored file of broadcast instructions that 

can be used in whole or in part as a starting point to produce a show. The show 
template can be located in a file on a directory or library on server 1 10 or another 
server that is a part of AVPS 116. AVPS 116 recalls the show template by 
filename, adds the news stories from the show folder, generates broadcast 
instructions and saves the broadcast instructions in a separate file or directory on a 
server. The broadcast instructions file is configurable to be modified by the 
director. The director can also change the show template as desired. 

[0063] FIG. 9 illustrates an embodiment of a graphical users interface (GUI) 900 

for generating and editing a show rundown located in show folder 902. In this 
embodiment, the director can utilize GUI 900 to open show folder 902 to view the 
news stories selected for the news program. The news stories are listed in 
rundown window 904. As shown, showfolder 902, in this representative 
embodiment, contains nineteen elements or news stories that has been selected by 
the producer. A brief description or short title for each element or news story is 
shown in slug column 906. As discussed above, each news story is linked to its 
associated script, graphics template, video clip or audio recording. 

[0064] The director can use GUI 900 to provide instructions or commands to 

enable AVPS 116 to translate the show rundown into broadcast instructions. As 
described in detail in the ' 161 application, the broadcast instructions (e.g., the 
ParkerVision ©Transition Macro™ timeline-based automation control program) 
comprises a set of video production commands, where each video production 
command is transmitted from a processing unit to a video production device. The 
broadcast instructions also refers to a set of icons that have been dragged and 
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dropped (i.e., assembled) onto the control lines of a computer-implemented time 
sheet (referred to herein as "broadcast instructions time sheet"). 

[0065] Referring back to FIG. 9, A VPS 116 in this embodiment translates the 

director's instructions provided in GUI 900 to populate the broadcast instructions 
time sheet with broadcast element (BCE) files. Typically, each line within the 
broadcast instructions corresponds to a video production station and/or 
equipment. For example, the broadcast instructions can include a line for a video 
switcher, one for an audio mixer, one for a CG/Still Store, one for teleprompting, 
several for cameras, several for video servers and VTRs, or the like. A group of 
these commands comprising of one or more lines represent an element as defined 
by a line from the director's rundown sheet. An example is a voice-over (VO) 
element. In this case, several commands are required to execute a VO element or 
line item on the director's rundown. Specifically, commands are required for a 
video switcher, audio mixer, teleprompter and VTR or Video Server. These 
commands would be entered on their respective control line(s) on the broadcast 
instructions time sheet to make up a "group" of commands that define the VO 
element. This grouping of commands to represent an element or group of 
elements is known as a BCE file (such as, the Transition Macro™ Element (TME) 
file developed by ParkerVision, Inc.). BCE files can represent a single line on the 
director's rundown or multiple lines that represent a complete story. 

[0066] Accordingly, the director would create BCE files comprising all the video 

production commands necessary to represent an element on the show rundown. In 
other words, the BCE files can be programmed to represent typical show 
segments found in the show rundown, such as INTRO/PKG/TAG, VO, SOT, 
OTS, VO/SOT combination, on camera and other elements or segments of a 
show. Accordingly, all the commands that the director would need to 
communicate with the production crew are illustrated and stored in the BCE files. 
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[0067] Once the BCE files have been created, the director would create an 

association file identifying an acronym that is tied to a specific BCE file. FIG. 8 
illustrates a representative embodiment of BCE GUI 800. In BCE GUI 800, 
acronym setup column 802 and BCE column 808 list all acronyms associated with 
their respective BCE files. GUI 800 provides a user friendly environment for the 
director to add or modify acronym association files and store them for future use. 
Referring back to FIG. 9, the acronym would be entered in acronym column 908 
for each news story or element listed in rundown window 904. In other words, the 
director would select a BCE file, which is associated with an acronym, and 
associate the BCE file with a news story. 

[0068] In addition, other columns are provided that allows the producer or 

director to enter CG/SS page identifiers, VTR timecodes and server file names. 
These columns minimize the amount of data required for entry by the director 
once the BCE files populate the broadcast elements time sheet. In another 
embodiment, additional columns are provided to enter data, extended play 
segments, scripts, graphics, advertisement and other URL links for enhanced 
media applications such as webcasting over the Internet or interactive television. 
The acronym links the show folder to the requisite video production commands or 
instructions in the BCE files. When the show rundown is air-ready, the director 
would activate the conversion process to pull the associated BCE files into the 
broadcast instructions time sheet. 

[0069] FIG. 10 illustrates a representative embodiment of GUI 1000 containing a 

broadcast instructions time sheet 1002. GUI 1000 includes a time sheet 1002, 
teleprompting system graphical controls 1008 for a controlling teleprompter 
system (e.g., teleprompter system 1 14), and character generator graphical controls 
1010 for controlling one or more character generators. As shown, time sheet 1002 
has not been populated with BCE files. To load the BCE files into time sheet 
1002, the director, in an embodiment, can activate an icon, use a pull-down menu 
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and the like to execute an import function. In this embodiment, import window 
1004 activated from a pull-down tab, identifies the ready-to-air rundown to be 
converted into broadcast instructions. To activate the director clicks on the 
"import" button. During the conversion process, the acronyms listed in acronym 
column 908 would call up the BCE files. 

[0070] As shown in FIG. 11, GUI 1 100 provides a representative embodiment of 

time sheet 1002 that has been populated with BGE files following the conversion 
process. In this embodiment, BCE files 1104A-1104E represents the video 
production commands for five elements from the show rundown. In an 
embodiment, different colors can be assigned to each of the BCE files 1104A- 
1104E to allow the director to quickly and visually identify the type of element 
(e.g., VO, INTRO, SOT and the like). 

[0071] FIG. 7 illustrates a representative embodiment of a teleprompter system 

GUI 700. The director can activate a show script monitoring program by clicking 
on an icon, using a pull-down menu and the like. GUI 700 is mapped to data 
server 624 and monitors it for changes. The monitoring program automatically 
pulls up scripts and associated elements in real time and parses out, for example, 
character generator data to insert into the appropriate character generator template 
with the character generator equipment. In another embodiment, scripts can be 
imported with embed commands and linked objects such as advertisements, 
graphics, data, extended play video or audio and other URL links that can be 
synchronized with the video program output for enhanced media webcasting over 
the Internet and Interactive Television. 

[0072] As discussed, a file containing the broadcast instructions can be stored on 

a server within system 100. The director can also change the show template as 
desired. Referring back to FIG. 3, at step 312, the director retrieves the broadcast 
instructions file, edits and/or approves the broadcast instructions for the news 
program. Upon approval, the broadcast instructions file is updated and saved to a 
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location on the server. Accordingly, the director can preview the show prior to air 
time. Alternatively, the broadcast instructions can be executed immediately. As 
such, the broadcast instruction would pull in all scripts, character generators and 
video as the show airs. Nonetheless, at step 316, AVPS 116 executes the show 
based on the director's approved broadcast instructions. As described in the '161 
application, the director can alter the broadcast instructions during the execution 
of the show. 

In an embodiment, once the ready-to-air producer's rundown is imported, 
the broadcast instructions time sheet is populated and ready for director review. 
During this process, the director checks transitions, CG/SS page identifiers, time 
code for VTRs, file names for video and audio servers and inputs the appropriate 
sources if changes are required or if generic BCEs (BCE files that represent 
element types such as VO or SOT but are not mapped to a specific source, i.e., 
camera, VTR, etc.) are used. The director can choose to drop, add, skip or modify 
stories or BCE files as required manually after the initial import of the show. The 
director can also run the show by blocks meaning that they can elect to import any 
changes during a show by importing the block (i.e., 1 104a-l 104e) yet to be aired. 
The present invention allows directors the flexibility to derive the method best 
suited for their environment. 

In an embodiment, a significant feature of the present invention is the 
ability to monitor and synchronize the producer's show rundown with the 
broadcast instructions. Referring to FIG. 3, at step 320, AVPS 116 automatically 
updates the approved broadcast instruction file as the show is executed. In other 
words, a processing unit (not shown) within the Full News Integration and 
Automation System 100 regularly monitors inter-file activity to detect changes in 
the show folder, including the script text, graphic effects, file locations, etc. The 
processing unit also detects the addition or deletion of news stories on the 
producer's show rundown. If any of these changes are detected, the broadcast 
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instructions are automatically revised to update the script, commands, 
instructions, timeline, etc. Since the news broadcast must be executed within an 
established time frame, e.g. a thirty minute news program, the processing unit 
only monitors and synchronizes the portion of the broadcast instructions that has 
not been executed. Moreover, the processing unit adjusts the remaining news 
stories and transitional elements to ensure that the total time for the show does not 
exceed the time scheduled for the news program in compliance with the 
producer's rundown that back times the show to alert the producer when the show 
architecture does or does not equal to pre-defined on-air time. The processing unit 
can be programmed to adjust the monitoring and synchronization protocol to meet 
the needs of the director. For instance, the processing unit can be configured to 
automatically detect and synchronize changes from the producer's show rundown 
in real time. Alternatively, the processing unit can be programmed to poll and 
synchronize the system, for example, every two minutes, or at some other time 
interval set by the director. The processing unit can be a component of AVPS 1 16, 
server 110, a separate processing device, or the like as would be apparent to a 
person skilled in the relevant art(s). 
[0075] Accordingly, the present invention eliminates the significant building time 

required to develop broadcast instructions. Typically, a thirty minute news 
program would take at least thirty to as much as ninety minutes to build, 
excluding the amount of time the director spends marking the producer's show 
rundown, itself. In the event of an extensive news breaking event, the entire 
rundown can change minutes before air time. The present invention overcomes 
this problem. By eliminating the thirty to ninety minute building time, the 
producer can make the necessary changes to the show rundown and the director 
can recapture and convert the rundown into new broadcast instructions in a very 
short time period. Moreover, the director and producer would be freed to work on 
other elements of the news program. 
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[0076] Upon completion of the broadcast, at step 324, AVPS 116 saves the 

executed broadcast instructions to a broadcast folder in a distinct directory or 
library. The broadcast folder is configured so that AVPS 116 can retrieve and 
execute part or all of the broadcast instructions in future shows if desired although 
it is quicker to build a show from scratch by re-importing a new rundown that 
uses different sources and BCE arrangements. In addition to the broadcast 
instructions, the broadcast folder also includes a link identifying the location of a 
video tape recording or virtual recording file of the broadcasted show. The video 
tape or virtual recording can be retrieved, viewed, edited or re-broadcasted via the 
airwaves or other distribution method such as the Internet. 

IV. Re-broadcasting in Full News Integration and Automation 

[0077] One feature of the present invention is the ability to re-broadcast a video 

show. For instance, one example of a rebroadcast is illustrated in FIG.4. In FIG. 
4, flowchart 400 represents the general operational flow of an embodiment of 
the present invention. More specifically, flowchart 400 shows an example of a 
control flow for producing a news program for subsequent broadcasts in a video 
production environment having full news integration and automation. 

[0078] At step 404, AVPS 116 receives a request to re-broadcast a specified 

show. The request can be generated from the director at workstation 112. 
Alternatively, the request can come from an Internet user accessing server 110 
from a web site configured to stream or play videos produced on AVPS 116. 

[0079] At step 408, AVPS 116 searches server 110 to determine whether the 

requested show is located in the broadcast directory or library. If the show cannot 
be located, at step 412, AVPS 116 notifies the requestor that the specified show is 
not available for broadcast. However, if AVPS 1 16 is able to locate the specified 
show, at step 416, the associated broadcast folder is selected. At step 420, AVPS 



SKGFRef.: 1752.0130001 



-27- 



116 determines whether the request is to re-execute the show's broadcast 
instructions or view the video affiliated with the broadcast folder. If the request is 
to re-execute the show's broadcast instructions, at step 424, AVPS 1 16 executes 
the show as described above in steps 312-324. However, if the request is to 
simply view the video, at step 428, the video tape or virtual file is located and 
loaded for viewing. The video or the virtual file is converted to a datagram and 
routed to the requestor at one of the workstations coupled to bus 118, or the 
datagram can be routed to an Internet user by using a Transmission Control 
Protocol (TCP) or User Datagram Protocol (UDP) over IP connection via server 
110, As would be apparent to a person skilled in the relevant art(s), alternative 
protocols can be used to transmit the video feeds to the requestor on a network or 
the global Internet. 

[0080] The present invention (i.e., system 100, AVPS 1 16, server 1 10 or any part 

thereof) can be implemented using hardware, software or a combination thereof 
and can be implemented in one or more computer systems or other processing 
systems. In fact, in an embodiment, the invention is directed toward one or more 
computer systems capable of carrying out the functionality described herein. 

V. Conclusion 

[0081] An exemplary computer system 500 useful in implementing the present 

invention is shown in FIG. 5. Computer system 500 includes one or more 
processors, such as processor 504. The processor 504 is connected to a 
communication infrastructure 506 (e.g., a communications bus, cross-over bar, or 
network). Various software embodiments are described in terms of this exemplary 
computer system. After reading this description, it will become apparent to a 
person skilled in the relevant art(s) how to implement the invention using other 
computer systems and/or computer architectures. 
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[0082] Computer system 500 can include a display interface 502 that forwards 

graphics, text, and other data from the communication infrastructure 506 (or from 
a frame buffer not shown) for display on the display unit 530. 

[0083] Computer system 500 also includes a main memory 508, preferably 

random access memory (RAM), and can also include a secondary memory 510. 
The secondary memory 510 can include, for example, a hard disk drive 512 
and/or a removable storage drive 514, representing a floppy disk drive, a magnetic 
tape drive, an optical disk drive, etc. The removable storage drive 514 reads from 
and/or writes to a removable storage unit 518 in a well-known manner. 
Removable storage unit 518, represents a floppy disk, magnetic tape, optical disk, 
etc. which is read by and written to removable storage drive 514. As will be 
appreciated, the removable storage unit 518 includes a computer usable storage 
medium having stored therein computer software and/or data. 

[0084] In alternative embodiments, secondary memory 510 can include other 

similar means for allowing computer programs or other instructions to be loaded 
into computer system 500. Such means can include, for example, a removable 
storage unit 522 and an interface 520. Examples of such can include a program 
cartridge and cartridge interface (such as that found in video game devices), a 
removable memory chip (such as an EPROM, or PROM) and associated socket, 
and other removable storage units 522 and interfaces 520 which allow software 
and data to be transferred from the removable storage unit 522 to computer 
system 500. 

[0085] Computer system 500 can also include a communications interface 524. 

Communications interface 524 allows software and data to be transferred between 
computer system 500 and external devices. Examples of communications 
interface 524 can include a modem, a network interface (such as an Ethernet 
card), a communications port, a PCMCIA slot and card, etc. Software and data 
transferred via communications interface 524 are in the form of signals 528 which 
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can be electronic, electromagnetic, optical or other signals capable of being 
received by communications interface 524. These signals 528 are provided to 
communications interface 524 via a communications path (i.e., channel) 526. This 
channel 526 carries signals 528 and can be implemented using wire or cable, fiber 
optics, a phone line, a cellular phone link, an RF link and other communications 
channels. 

[0086] In this document, the terms "computer program medium" and "computer 

usable medium" are used to generally refer to media such as removable storage 
drive 514, a hard disk installed in hard disk drive 512, and signals 528. These 
computer program products are means for providing software to computer system 
500. The invention is directed to such computer program products. 

[0087] Computer programs (also called computer control logic) are stored in main 

memory 508 and/or secondary memory 510. Computer programs can also be 
received via communications interface 524. Such computer programs, when 
executed, enable the computer system 500 to perform the features of the present 
invention as discussed herein. In particular, the computer programs, when 
executed, enable the processor 504 to perform the features of the present 
invention. Accordingly, such computer programs represent controllers of the 
computer system 500. 

[0088] In an embodiment where the invention is implemented using software, the 

software can be stored in a computer program product and loaded into computer 
system 500 using removable storage drive 514, hard drive 512 or communications 
interface 524. The control logic (software), when executed by the processor 504, 
causes the processor 504 to perform the functions of the invention as described 
herein. 

[0089] In another embodiment, the invention is implemented primarily in 

hardware using, for example, hardware components such as application specific 
integrated circuits (ASICs). Implementation of the hardware state machine so as 
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to perform the functions described herein will be apparent to persons skilled in the 
relevant art(s). 

[0090] In yet another embodiment, the invention is implemented using a 

combination of both hardware and software. 

[0091] While various embodiments of the present invention have been described 

above, it should be understood that they have been presented by way of example 
only, and not limitation. Thus, the breadth and scope of the present invention 
should not be limited by any of the above-described exemplary embodiments, but 
should be defined only in accordance with the following claims and their 
equivalents. 
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WHAT IS CLAIMED IS: 

1. A method for producing a show in a video production environment 
having at least one processing unit in communications with a plurality of video 
production devices, comprising the steps of: 

(a) receiving a show rundown comprising a plurality of news 
story files selected from a story bin; and 

(b) converting said show rundown into broadcast instructions 
formatted for being executed on an automated video production system. 

2. A method of claim 1, wherein each of said news story files 
includes a script formatted for a teleprompting means and graphic effects to be 
executed on said automated video production means. 

3. A method of claim 1, further comprising the step of: 

(c) monitoring inter-file activity and synchronizing said show - 
rundown with said broadcast instructions. 

4. A method of claim 3, wherein said step (c) further comprises the 

step of: 

(i) periodically polling said show rundown to detect inter-file 
modifications, including changes within said news story file or the addition or 
deletion of news stories to said show rundown. 

5. A method of claim 4, wherein said step (c) further comprises the 

step of: 

(ii) updating said broadcast instructions with said inter-file 
modifications to implement said synchronization. 
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6. A method of claim 5, wherein said step (ii) further comprises the 

step of: 

(A) updating only an unexecuted portion of said broadcast 

instructions. 

7. A method of claim 6, wherein said step (ii) further comprises the 

step of: 

(B) adjusting said unexecuted broadcast instructions such that a 
total execution time for said broadcast instructions does not exceed a 
predetermined time. 

8. A method of claim 3, wherein said step (c) further comprises the 

step of: 

updating said broadcast instructions in real time with inter-file 
modifications, including changes within said news story file or the addition or 
deletion of news stories to said show rundown. 

9. A method of claim 1, further comprising the step associating a 
broadcast element file with each news story file of said plurality of news story 
files to link a group of video production commands to each news story file. 

10. A method of claim 9, wherein said step (b) further comprises the 
step of populating a broadcast instructions time sheet with video production icons 
formatted to instruct the automated video production system to execute video 
production commands, wherein a group of video production icons is associated 
with a broadcast element file. 
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11. A system for producing a show in a video production environment 
having at least one processing unit in communications with a plurality of video 
production devices, comprising: 

means for receiving a show rundown comprising a plurality of 
news story files selected from a story bin; and 

means for converting said show rundown into broadcast 
instructions formatted for being executed on an automated video production 
means. 

12. A system of claim 1 1 , further comprising: 

means for monitoring inter-file activity and synchronizing said 
show rundown with said broadcast instructions 

13. A computer program product comprising a computer useable 
medium having computer readable program code means embedded in said 
medium for causing an application program to execute on a computer used to 
produce a show in a video production environment having at least one processing 
unit in communications with a plurality of video production devices, said 
computer readable program code means comprising: 

a first computer readable program code means for receiving a show 
rundown comprising a plurality of news story files selected from a story bin; and 

a second computer readable program code means for converting 
said show rundown into broadcast instructions formatted for being executed on an 
automated video production means. 
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14. A computer program product according to claim 13, further 
comprising: 

a third computer readable program code means for monitoring 
inter-file activity and synchronizing said show rundown with said broadcast 
instructions. 
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METHOD, SYSTEM AND COMPUTER PROGRAM PRODUCT FOR FULL 
NEWS INTEGRATION AND AUTOMATION IN A REAL TIME VIDEO 
PRODUCTION ENVIRONMENT 

ABSTRACT OF THE DISCLOSURE 



An automated video production system having full news integration and 
automation. The automated video production system enables a producer to create 
a show rundown by selecting news stories for a live or live-to-tape video show. 
The system supports real time conversion of the show rundown into computer 
readable broadcast instructions for executing the news program. After the 
broadcast instructions are created, the director can instruct the system to execute 
the broadcast instructions in either a fully or semi-automatic mode. The fully 
integrated and automated video production system periodically monitors and 
synchronizes the show rundown with the broadcast instructions. After the show 
has been broadcasted, the broadcast instructions and a video recording of the 
show is stored for future use. For instance, the broadcast instructions can be 
retrieved and used in another show. Similarly, the recording of the show can be 
retrieved and re-broadcasted, for example, over the Internet. 
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